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Today 


• Agents that Plan Ahead 

• Search Problems 

• Uninformed Search Methods 

• Depth-First Search 

• Breadth-First Search 

• Uniform-Cost Search 








Reflex Agents 


• Reflex agents: 

* Choose action based on current percept (and 
maybe memory) 

* May have memory or a model of the world's 
current state 

* Do not consider the future consequences of 
their actions 

* Consider how the world IS 


• Can a reflex agent be rational? 



[demo: reflex optimal / loop ] 




Planning Agents 


• Planning agents: 

• Ask "what if" 

• Decisions based on (hypothesized} 
consequences of actions 

• Must have a model of how the world evolves in 
response to actions 

• Must formulate a goal (test) 

• Consider how the world WOULD IBE 


• Optimal vs. complete planning 

• Planning vs. replanning 



[demo: plan fast / slow ] 




Search Problems 


• A search problem consists of: 



• A successor function 
(with actions, costs) 

"E" 1.0 

* A start state and a goal test 

* A solution is a sequence of actions (a plan) which 
transforms the start state to a goal state 









Example: Traveling in Romania 
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• State space: 

* Cities 

• Successor function: 

* Roads: Go to adjacent city with 
cost = distance 

• Start state: 

* Arad 

• Goal test: 

* Is sta te == B u ch a rest? 

• Solution? 





What's in a State Space? 





The world state includes every last detail of the environment 



HP 


A search state keeps only the details needed for planning (abstraction) 


Problem 

• • 

• States: (x,y) location 

• Actions: NSEW 


Successor: update location 


only 




• Goal test: is 


(x,y)=END 




• States: {(x,y), dot booleans} 

• Actions: NSEW 

• Successor: update location 
and possibly a dot boolea 

.’ 3 *'*!'. * - 

• Goal test: dots all false 




State Space Sizes? 


* World state: 

• Agent positions: 120 

• Food count: 30 

• Ghost positions: 12 

• Agent facing: NSEW 

* How many 

• World states? 
12Gx(2 30 )x(12 3 )x4 

• States for pa thing? 

120 

• States for eat -all-dots? 
120x 2 30 )} 




Quiz: Safe Passage 


* Problem: eat all dots while keeping the ghosts perma-scared 

Select all components that are required in the state-space representation for 

the search problem. 

You may assume that the ghosts are already scared at the start of the game.- 

1. Pacman's position 

2. The position of each ghost 

3. A boolean for each dot that represents whether it has been eaten 

4. A boolean for each power pellet that represents whether it has been eaten 

5. The remaining amount of time for which the ghosts will be scared all previous 
locations that each ghost has visited 

* What does the state space have to specify? 

* agent position, dot boolleans, power pellet booleans, remaining scared time) 



State Space Graphs 


State space graph: A mathematical 
representation of a search problem 

* Nodes a re (abstracted) world configurations 

* Arcs represent successors (action results) 

* The goa I test is a set of goa I nodes (maybe only one) 

In a search graph, each state occurs only once! 

We can rarely build this full graph in memory 
{it's too big), but it's a useful idea 
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State Space Graphs 


• State space graph: A mathematical 
representation of a search problem 

* Nodes are [abstracted) world configurations 

* Arcs represent successors (action results) 

* The goal test is a set of goal nodes (maybe only one) 


• In a search graph, each state occurs only once! 



• We can rarely build this full graph in memory 
(it's too big), but it's a useful idea 


Tiny search graph for a tiny 
search problem 




Search Trees 








This is now / start 


Possible futures 


* A search tree: 

* A "what if" tree of plans and their outcomes 

* The start state is the root node 

* Children correspond to successors 

* Nodes show states, but correspond to PLANS that achieve those states 

* For most problems, we can never actually build the whole tree 



State Graphs vs. Search Trees 



Each NODE in in 
the search tree is 
an entire PATH in 
the problem graph. 


We construct both 
on demand - and 
we construct as 
little as possible . 









Search Example: Romania 
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General Tree Search 


function I RfT-Sr.\nni( prt»W«ii. s<rti/rjy) returns a solution, or failure 
initialize the search tree using the initial state of problem 
loop do 

if there are no candidates for expansion then return failure 
choose a leaf node for expansion according to strategy 

if the node contains a goal state then return the corresponding solution 
else expand the node and add the resulting nodes to the search tree 

curl 


• Important ideas: 

• Fringe: which is all of the plans that may yet work. 

• Expansion: which is picking something out of the fringe, and if it's not a 
goal already. 

• Exploration strategy: What fringe nodes do you explore next? 

• Main question: which fringe nodes to explore? 



Example: Tree Search 





Thanks 



